WIP: Upgrade DataFusion to arrow-rs/parquet 58.0.0 #19728

alamb · 2026-01-10T12:19:14Z

Which issue does this PR close?

Follow on to Upgrade DataFusion to arrow-rs/parquet 57.2.0 #19355
related to Release arrow-rs / parquet Major version 58.0.0 (January 2026) arrow-rs#8466

Rationale for this change

Keep datafusion up to date (and test Arrow using DataFusion tests)

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

….2.0

alamb · 2026-01-10T12:30:27Z

datafusion/sqllogictest/test_files/spark/datetime/make_interval.slt

 # We expect something like 0.00 secs with query ?
 query T
 SELECT make_interval(0, 0, 0, 0, 0, 0, 0.0) || '';
 ----


This is due to @Jefffrey 's improvement in

fix: display 0 secs for empty DayTime/MonthDayNano intervals arrow-rs#9023

close #17455

Probably should remove the accompanying comments too, these

# Intervals being rendered as empty string, see issue: # https://github.com/apache/datafusion/issues/17455 # We expect something like 0.00 secs with query ?

alamb · 2026-01-10T13:42:26Z

datafusion-cli/src/main.rs

        | alltypes_plain.parquet            | 1851            | 8882                | 2    | page_index=false |
-        | alltypes_tiny_pages.parquet       | 454233          | 269266              | 2    | page_index=true  |
-        | lz4_raw_compressed_larger.parquet | 380836          | 1347                | 2    | page_index=false |
+        | alltypes_tiny_pages.parquet       | 454233          | 269074              | 2    | page_index=true  |


I think this reduction in metadata size is a direct consequence of @WaterWhisperer's PR to improve PageEncoding representation

feat: change default behavior for Parquet PageEncodingStats to bitmask arrow-rs#9051

Dandandan · 2026-01-10T14:18:49Z

Run benchmarks

alamb-ghbot · 2026-01-10T17:46:31Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (35b97fa) to b9a3b9f diff using: tpch_mem clickbench_partitioned clickbench_extended
Results will be posted here when complete

alamb-ghbot · 2026-01-10T18:26:55Z

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow_58
--------------------
Benchmark clickbench_extended.json
--------------------
┏━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Query    ┃        HEAD ┃ alamb_update_arrow_58 ┃    Change ┃
┡━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ QQuery 0 │  2354.54 ms │            2406.77 ms │ no change │
│ QQuery 1 │   939.82 ms │             929.76 ms │ no change │
│ QQuery 2 │  1882.93 ms │            1891.80 ms │ no change │
│ QQuery 3 │  1163.47 ms │            1165.13 ms │ no change │
│ QQuery 4 │  2306.07 ms │            2241.55 ms │ no change │
│ QQuery 5 │ 28452.06 ms │           28080.09 ms │ no change │
│ QQuery 6 │  4018.71 ms │            4055.12 ms │ no change │
│ QQuery 7 │  3790.29 ms │            3670.14 ms │ no change │
└──────────┴─────────────┴───────────────────────┴───────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 44907.89ms │
│ Total Time (alamb_update_arrow_58)   │ 44440.36ms │
│ Average Time (HEAD)                  │  5613.49ms │
│ Average Time (alamb_update_arrow_58) │  5555.05ms │
│ Queries Faster                       │          0 │
│ Queries Slower                       │          0 │
│ Queries with No Change               │          8 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃        HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0  │     1.86 ms │               1.94 ms │     no change │
│ QQuery 1  │    50.56 ms │              50.42 ms │     no change │
│ QQuery 2  │   134.60 ms │             134.00 ms │     no change │
│ QQuery 3  │   156.94 ms │             152.15 ms │     no change │
│ QQuery 4  │  1074.92 ms │            1227.05 ms │  1.14x slower │
│ QQuery 5  │  1349.11 ms │            1512.35 ms │  1.12x slower │
│ QQuery 6  │     1.82 ms │               1.86 ms │     no change │
│ QQuery 7  │    56.21 ms │              53.80 ms │     no change │
│ QQuery 8  │  1404.44 ms │            1546.63 ms │  1.10x slower │
│ QQuery 9  │  1744.32 ms │            1884.58 ms │  1.08x slower │
│ QQuery 10 │   344.43 ms │             351.00 ms │     no change │
│ QQuery 11 │   393.88 ms │             399.97 ms │     no change │
│ QQuery 12 │  1259.31 ms │            1442.13 ms │  1.15x slower │
│ QQuery 13 │  1916.02 ms │            2053.79 ms │  1.07x slower │
│ QQuery 14 │  1228.80 ms │            1371.03 ms │  1.12x slower │
│ QQuery 15 │  1223.04 ms │            1359.64 ms │  1.11x slower │
│ QQuery 16 │  2568.94 ms │            2675.51 ms │     no change │
│ QQuery 17 │  2521.47 ms │            2647.03 ms │     no change │
│ QQuery 18 │  6120.19 ms │            5000.68 ms │ +1.22x faster │
│ QQuery 19 │   120.13 ms │             119.44 ms │     no change │
│ QQuery 20 │  1948.33 ms │            1896.06 ms │     no change │
│ QQuery 21 │  2245.14 ms │            2178.01 ms │     no change │
│ QQuery 22 │  3847.87 ms │            3802.23 ms │     no change │
│ QQuery 23 │ 21572.08 ms │           12373.92 ms │ +1.74x faster │
│ QQuery 24 │   225.72 ms │             216.64 ms │     no change │
│ QQuery 25 │   471.41 ms │             478.99 ms │     no change │
│ QQuery 26 │   218.83 ms │             235.13 ms │  1.07x slower │
│ QQuery 27 │  2823.98 ms │            2691.15 ms │     no change │
│ QQuery 28 │ 23860.88 ms │           23263.75 ms │     no change │
│ QQuery 29 │   982.83 ms │             966.29 ms │     no change │
│ QQuery 30 │  1343.19 ms │            1378.01 ms │     no change │
│ QQuery 31 │  1521.78 ms │            1379.20 ms │ +1.10x faster │
│ QQuery 32 │  5104.40 ms │            4890.24 ms │     no change │
│ QQuery 33 │  5837.64 ms │            5506.92 ms │ +1.06x faster │
│ QQuery 34 │  5933.39 ms │            5605.95 ms │ +1.06x faster │
│ QQuery 35 │  1921.56 ms │            1960.63 ms │     no change │
│ QQuery 36 │    65.96 ms │              68.18 ms │     no change │
│ QQuery 37 │    45.85 ms │              45.16 ms │     no change │
│ QQuery 38 │    66.53 ms │              65.89 ms │     no change │
│ QQuery 39 │   102.71 ms │             106.18 ms │     no change │
│ QQuery 40 │    28.23 ms │              25.52 ms │ +1.11x faster │
│ QQuery 41 │    24.10 ms │              23.51 ms │     no change │
│ QQuery 42 │    19.09 ms │              18.80 ms │     no change │
└───────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃             ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 103882.45ms │
│ Total Time (alamb_update_arrow_58)   │  93161.37ms │
│ Average Time (HEAD)                  │   2415.87ms │
│ Average Time (alamb_update_arrow_58) │   2166.54ms │
│ Queries Faster                       │           6 │
│ Queries Slower                       │           9 │
│ Queries with No Change               │          28 │
│ Queries with Failure                 │           0 │
└──────────────────────────────────────┴─────────────┘
--------------------
Benchmark tpch_mem_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃      HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │ 119.70 ms │             118.08 ms │     no change │
│ QQuery 2  │  35.82 ms │              36.60 ms │     no change │
│ QQuery 3  │  40.70 ms │              36.99 ms │ +1.10x faster │
│ QQuery 4  │  30.37 ms │              30.72 ms │     no change │
│ QQuery 5  │  91.59 ms │              90.47 ms │     no change │
│ QQuery 6  │  21.09 ms │              20.76 ms │     no change │
│ QQuery 7  │ 222.34 ms │             225.43 ms │     no change │
│ QQuery 8  │  44.85 ms │              40.29 ms │ +1.11x faster │
│ QQuery 9  │ 122.80 ms │             104.76 ms │ +1.17x faster │
│ QQuery 10 │  81.06 ms │              66.33 ms │ +1.22x faster │
│ QQuery 11 │  23.80 ms │              24.89 ms │     no change │
│ QQuery 12 │  52.22 ms │              52.78 ms │     no change │
│ QQuery 13 │  48.94 ms │              49.75 ms │     no change │
│ QQuery 14 │  14.95 ms │              14.96 ms │     no change │
│ QQuery 15 │  30.50 ms │              30.48 ms │     no change │
│ QQuery 16 │  28.47 ms │              29.06 ms │     no change │
│ QQuery 17 │ 151.61 ms │             154.03 ms │     no change │
│ QQuery 18 │ 287.03 ms │             288.27 ms │     no change │
│ QQuery 19 │  39.57 ms │              39.77 ms │     no change │
│ QQuery 20 │  57.69 ms │              57.36 ms │     no change │
│ QQuery 21 │ 322.81 ms │             318.54 ms │     no change │
│ QQuery 22 │  21.98 ms │              21.61 ms │     no change │
└───────────┴───────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃           ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 1889.89ms │
│ Total Time (alamb_update_arrow_58)   │ 1851.95ms │
│ Average Time (HEAD)                  │   85.90ms │
│ Average Time (alamb_update_arrow_58) │   84.18ms │
│ Queries Faster                       │         4 │
│ Queries Slower                       │         0 │
│ Queries with No Change               │        18 │
│ Queries with Failure                 │         0 │
└──────────────────────────────────────┴───────────┘

Dandandan · 2026-01-10T18:32:08Z

run benchmarks

Dandandan · 2026-01-10T18:32:18Z

run benchmark tpch

alamb-ghbot · 2026-01-10T18:40:16Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (35b97fa) to b9a3b9f diff using: tpch_mem clickbench_partitioned clickbench_extended
Results will be posted here when complete

alamb-ghbot · 2026-01-10T19:18:22Z

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow_58
--------------------
Benchmark clickbench_extended.json
--------------------
┏━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Query    ┃        HEAD ┃ alamb_update_arrow_58 ┃    Change ┃
┡━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ QQuery 0 │  2389.61 ms │            2355.66 ms │ no change │
│ QQuery 1 │   975.65 ms │             969.78 ms │ no change │
│ QQuery 2 │  1875.49 ms │            1871.78 ms │ no change │
│ QQuery 3 │  1174.32 ms │            1145.53 ms │ no change │
│ QQuery 4 │  2258.94 ms │            2223.01 ms │ no change │
│ QQuery 5 │ 27824.57 ms │           28406.72 ms │ no change │
│ QQuery 6 │  4031.59 ms │            4002.29 ms │ no change │
│ QQuery 7 │  3463.56 ms │            3533.17 ms │ no change │
└──────────┴─────────────┴───────────────────────┴───────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 43993.73ms │
│ Total Time (alamb_update_arrow_58)   │ 44507.93ms │
│ Average Time (HEAD)                  │  5499.22ms │
│ Average Time (alamb_update_arrow_58) │  5563.49ms │
│ Queries Faster                       │          0 │
│ Queries Slower                       │          0 │
│ Queries with No Change               │          8 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃        HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0  │     1.90 ms │               1.92 ms │     no change │
│ QQuery 1  │    52.12 ms │              50.35 ms │     no change │
│ QQuery 2  │   142.92 ms │             133.95 ms │ +1.07x faster │
│ QQuery 3  │   154.00 ms │             152.77 ms │     no change │
│ QQuery 4  │  1072.51 ms │            1063.15 ms │     no change │
│ QQuery 5  │  1369.60 ms │            1320.07 ms │     no change │
│ QQuery 6  │     1.82 ms │               1.86 ms │     no change │
│ QQuery 7  │    54.39 ms │              52.98 ms │     no change │
│ QQuery 8  │  1446.73 ms │            1417.75 ms │     no change │
│ QQuery 9  │  1835.01 ms │            1706.51 ms │ +1.08x faster │
│ QQuery 10 │   344.52 ms │             354.29 ms │     no change │
│ QQuery 11 │   392.19 ms │             397.62 ms │     no change │
│ QQuery 12 │  1286.14 ms │            1275.41 ms │     no change │
│ QQuery 13 │  1947.40 ms │            1962.96 ms │     no change │
│ QQuery 14 │  1259.13 ms │            1231.11 ms │     no change │
│ QQuery 15 │  1247.90 ms │            1222.46 ms │     no change │
│ QQuery 16 │  2534.25 ms │            2515.84 ms │     no change │
│ QQuery 17 │  2514.25 ms │            2527.22 ms │     no change │
│ QQuery 18 │  5440.35 ms │            4806.73 ms │ +1.13x faster │
│ QQuery 19 │   119.26 ms │             118.76 ms │     no change │
│ QQuery 20 │  1929.28 ms │            1872.84 ms │     no change │
│ QQuery 21 │  2213.86 ms │            2178.92 ms │     no change │
│ QQuery 22 │  4264.32 ms │            3784.45 ms │ +1.13x faster │
│ QQuery 23 │ 20258.80 ms │           12236.28 ms │ +1.66x faster │
│ QQuery 24 │   215.95 ms │             219.20 ms │     no change │
│ QQuery 25 │   488.91 ms │             481.13 ms │     no change │
│ QQuery 26 │   226.35 ms │             216.76 ms │     no change │
│ QQuery 27 │  2799.99 ms │            2713.67 ms │     no change │
│ QQuery 28 │ 23840.67 ms │           23084.98 ms │     no change │
│ QQuery 29 │   974.43 ms │             971.18 ms │     no change │
│ QQuery 30 │  1351.52 ms │            1299.11 ms │     no change │
│ QQuery 31 │  1399.75 ms │            1421.76 ms │     no change │
│ QQuery 32 │  4761.26 ms │            4490.64 ms │ +1.06x faster │
│ QQuery 33 │  5521.96 ms │            5313.98 ms │     no change │
│ QQuery 34 │  5548.81 ms │            5584.56 ms │     no change │
│ QQuery 35 │  1979.74 ms │            1851.73 ms │ +1.07x faster │
│ QQuery 36 │    66.91 ms │              67.24 ms │     no change │
│ QQuery 37 │    46.16 ms │              47.24 ms │     no change │
│ QQuery 38 │    66.08 ms │              67.97 ms │     no change │
│ QQuery 39 │   102.12 ms │             100.78 ms │     no change │
│ QQuery 40 │    28.61 ms │              27.21 ms │     no change │
│ QQuery 41 │    23.45 ms │              22.02 ms │ +1.06x faster │
│ QQuery 42 │    19.24 ms │              19.38 ms │     no change │
└───────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃             ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 101344.52ms │
│ Total Time (alamb_update_arrow_58)   │  90386.74ms │
│ Average Time (HEAD)                  │   2356.85ms │
│ Average Time (alamb_update_arrow_58) │   2102.02ms │
│ Queries Faster                       │           8 │
│ Queries Slower                       │           0 │
│ Queries with No Change               │          35 │
│ Queries with Failure                 │           0 │
└──────────────────────────────────────┴─────────────┘
--------------------
Benchmark tpch_mem_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃      HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │ 118.62 ms │             117.02 ms │     no change │
│ QQuery 2  │  37.93 ms │              38.57 ms │     no change │
│ QQuery 3  │  41.97 ms │              37.52 ms │ +1.12x faster │
│ QQuery 4  │  31.39 ms │              30.22 ms │     no change │
│ QQuery 5  │  91.63 ms │              91.98 ms │     no change │
│ QQuery 6  │  21.13 ms │              20.89 ms │     no change │
│ QQuery 7  │ 229.95 ms │             228.06 ms │     no change │
│ QQuery 8  │  39.25 ms │              37.93 ms │     no change │
│ QQuery 9  │ 107.60 ms │             107.66 ms │     no change │
│ QQuery 10 │  69.45 ms │              69.75 ms │     no change │
│ QQuery 11 │  23.16 ms │              24.35 ms │  1.05x slower │
│ QQuery 12 │  53.07 ms │              52.75 ms │     no change │
│ QQuery 13 │  51.17 ms │              48.55 ms │ +1.05x faster │
│ QQuery 14 │  15.28 ms │              15.11 ms │     no change │
│ QQuery 15 │  30.14 ms │              30.73 ms │     no change │
│ QQuery 16 │  31.26 ms │              29.13 ms │ +1.07x faster │
│ QQuery 17 │ 159.46 ms │             154.29 ms │     no change │
│ QQuery 18 │ 287.59 ms │             284.81 ms │     no change │
│ QQuery 19 │  39.20 ms │              39.99 ms │     no change │
│ QQuery 20 │  56.56 ms │              57.03 ms │     no change │
│ QQuery 21 │ 300.14 ms │             325.49 ms │  1.08x slower │
│ QQuery 22 │  22.64 ms │              22.18 ms │     no change │
└───────────┴───────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃           ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 1858.59ms │
│ Total Time (alamb_update_arrow_58)   │ 1864.00ms │
│ Average Time (HEAD)                  │   84.48ms │
│ Average Time (alamb_update_arrow_58) │   84.73ms │
│ Queries Faster                       │         3 │
│ Queries Slower                       │         2 │
│ Queries with No Change               │        17 │
│ Queries with Failure                 │         0 │
└──────────────────────────────────────┴───────────┘

Dandandan · 2026-01-22T20:31:35Z

run benchmarks

alamb-ghbot · 2026-01-22T20:34:17Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (917a464) to 3d90d4b diff using: tpch_mem clickbench_partitioned clickbench_extended
Results will be posted here when complete

alamb-ghbot · 2026-01-22T21:15:35Z

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow_58
--------------------
Benchmark clickbench_extended.json
--------------------
┏━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query    ┃        HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0 │  2495.53 ms │            2437.20 ms │     no change │
│ QQuery 1 │   929.81 ms │             915.84 ms │     no change │
│ QQuery 2 │  1952.57 ms │            1869.42 ms │     no change │
│ QQuery 3 │  1142.65 ms │            1116.84 ms │     no change │
│ QQuery 4 │  2448.50 ms │            2252.95 ms │ +1.09x faster │
│ QQuery 5 │ 29374.28 ms │           29178.90 ms │     no change │
│ QQuery 6 │  4055.61 ms │            4032.52 ms │     no change │
│ QQuery 7 │  2874.31 ms │            3081.93 ms │  1.07x slower │
└──────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 45273.26ms │
│ Total Time (alamb_update_arrow_58)   │ 44885.62ms │
│ Average Time (HEAD)                  │  5659.16ms │
│ Average Time (alamb_update_arrow_58) │  5610.70ms │
│ Queries Faster                       │          1 │
│ Queries Slower                       │          1 │
│ Queries with No Change               │          6 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃        HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0  │     1.97 ms │               2.15 ms │  1.09x slower │
│ QQuery 1  │    52.94 ms │              52.70 ms │     no change │
│ QQuery 2  │   133.94 ms │             152.97 ms │  1.14x slower │
│ QQuery 3  │   151.62 ms │             162.29 ms │  1.07x slower │
│ QQuery 4  │  1087.68 ms │            1131.05 ms │     no change │
│ QQuery 5  │  1520.19 ms │            1576.49 ms │     no change │
│ QQuery 6  │     2.35 ms │               2.42 ms │     no change │
│ QQuery 7  │    61.92 ms │              60.70 ms │     no change │
│ QQuery 8  │  1586.07 ms │            1598.87 ms │     no change │
│ QQuery 9  │  1879.67 ms │            2087.13 ms │  1.11x slower │
│ QQuery 10 │   382.49 ms │             363.46 ms │     no change │
│ QQuery 11 │   433.26 ms │             437.22 ms │     no change │
│ QQuery 12 │  1411.84 ms │            1432.50 ms │     no change │
│ QQuery 13 │  2130.15 ms │            2149.71 ms │     no change │
│ QQuery 14 │  1360.02 ms │            1330.73 ms │     no change │
│ QQuery 15 │  1371.99 ms │            1358.63 ms │     no change │
│ QQuery 16 │  2779.34 ms │            2794.96 ms │     no change │
│ QQuery 17 │  2777.79 ms │            2752.67 ms │     no change │
│ QQuery 18 │  6482.04 ms │            5320.53 ms │ +1.22x faster │
│ QQuery 19 │   131.67 ms │             126.99 ms │     no change │
│ QQuery 20 │  2156.59 ms │            1929.50 ms │ +1.12x faster │
│ QQuery 21 │  2520.31 ms │            2225.12 ms │ +1.13x faster │
│ QQuery 22 │  4252.15 ms │            3746.65 ms │ +1.13x faster │
│ QQuery 23 │ 12645.62 ms │           12010.30 ms │ +1.05x faster │
│ QQuery 24 │   214.94 ms │             207.09 ms │     no change │
│ QQuery 25 │   468.30 ms │             460.92 ms │     no change │
│ QQuery 26 │   237.05 ms │             216.18 ms │ +1.10x faster │
│ QQuery 27 │  2979.84 ms │            2695.02 ms │ +1.11x faster │
│ QQuery 28 │ 24218.08 ms │           22099.55 ms │ +1.10x faster │
│ QQuery 29 │  1050.54 ms │             981.68 ms │ +1.07x faster │
│ QQuery 30 │  1438.78 ms │            1277.27 ms │ +1.13x faster │
│ QQuery 31 │  1500.36 ms │            1337.48 ms │ +1.12x faster │
│ QQuery 32 │  4651.76 ms │            4112.37 ms │ +1.13x faster │
│ QQuery 33 │  5996.92 ms │            5526.08 ms │ +1.09x faster │
│ QQuery 34 │  6090.92 ms │            5880.35 ms │     no change │
│ QQuery 35 │  2089.61 ms │            2002.44 ms │     no change │
│ QQuery 36 │    74.11 ms │              70.62 ms │     no change │
│ QQuery 37 │    49.76 ms │              46.53 ms │ +1.07x faster │
│ QQuery 38 │    70.60 ms │              68.40 ms │     no change │
│ QQuery 39 │   109.80 ms │             106.03 ms │     no change │
│ QQuery 40 │    30.41 ms │              30.99 ms │     no change │
│ QQuery 41 │    26.12 ms │              25.67 ms │     no change │
│ QQuery 42 │    21.30 ms │              22.25 ms │     no change │
└───────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 98632.80ms │
│ Total Time (alamb_update_arrow_58)   │ 91972.64ms │
│ Average Time (HEAD)                  │  2293.79ms │
│ Average Time (alamb_update_arrow_58) │  2138.90ms │
│ Queries Faster                       │         14 │
│ Queries Slower                       │          4 │
│ Queries with No Change               │         25 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘
--------------------
Benchmark tpch_mem_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃      HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │ 114.26 ms │             106.79 ms │ +1.07x faster │
│ QQuery 2  │  35.18 ms │              32.46 ms │ +1.08x faster │
│ QQuery 3  │  40.80 ms │              38.08 ms │ +1.07x faster │
│ QQuery 4  │  35.17 ms │              30.45 ms │ +1.15x faster │
│ QQuery 5  │ 103.64 ms │              85.13 ms │ +1.22x faster │
│ QQuery 6  │  22.09 ms │              20.49 ms │ +1.08x faster │
│ QQuery 7  │ 173.08 ms │             148.43 ms │ +1.17x faster │
│ QQuery 8  │  45.03 ms │              38.52 ms │ +1.17x faster │
│ QQuery 9  │ 108.22 ms │             101.93 ms │ +1.06x faster │
│ QQuery 10 │  72.74 ms │              63.86 ms │ +1.14x faster │
│ QQuery 11 │  19.80 ms │              18.99 ms │     no change │
│ QQuery 12 │  53.27 ms │              51.97 ms │     no change │
│ QQuery 13 │  52.66 ms │              51.12 ms │     no change │
│ QQuery 14 │  16.47 ms │              15.44 ms │ +1.07x faster │
│ QQuery 15 │  33.09 ms │              30.28 ms │ +1.09x faster │
│ QQuery 16 │  29.82 ms │              28.64 ms │     no change │
│ QQuery 17 │ 156.68 ms │             142.66 ms │ +1.10x faster │
│ QQuery 18 │ 298.66 ms │             272.96 ms │ +1.09x faster │
│ QQuery 19 │  41.23 ms │              40.19 ms │     no change │
│ QQuery 20 │  60.26 ms │              60.58 ms │     no change │
│ QQuery 21 │ 192.33 ms │             192.45 ms │     no change │
│ QQuery 22 │  23.11 ms │              22.57 ms │     no change │
└───────────┴───────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃           ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 1727.58ms │
│ Total Time (alamb_update_arrow_58)   │ 1593.99ms │
│ Average Time (HEAD)                  │   78.53ms │
│ Average Time (alamb_update_arrow_58) │   72.45ms │
│ Queries Faster                       │        14 │
│ Queries Slower                       │         0 │
│ Queries with No Change               │         8 │
│ Queries with Failure                 │         0 │
└──────────────────────────────────────┴───────────┘

Dandandan · 2026-01-22T21:22:14Z

run benchmark tpch tcpds clickbench_partitioned

alamb-ghbot · 2026-01-22T21:22:16Z

🤖 Hi @Dandandan, thanks for the request (#19728 (comment)).

scrape_comments.py only supports whitelisted benchmarks.

Standard: clickbench_1, clickbench_extended, clickbench_partitioned, clickbench_pushdown, external_aggr, tpcds, tpch, tpch10, tpch_mem, tpch_mem10
Criterion: aggregate_query_sql, aggregate_vectorized, case_when, character_length, in_list, left, range_and_generate_series, reset_plan_states, sort, sql_planner, strpos, substr_index, with_hashes

Please choose one or more of these with run benchmark <name> or run benchmark <name1> <name2>...
Unsupported benchmarks: tcpds.

Dandandan · 2026-01-22T21:22:43Z

run benchmark tpch tpcds clickbench_partitioned

alamb-ghbot · 2026-01-22T23:10:37Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (917a464) to 3d90d4b diff using: tpch
Results will be posted here when complete

alamb-ghbot · 2026-01-22T23:11:19Z

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow_58
--------------------
Benchmark tpch_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃      HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │ 193.39 ms │             196.59 ms │     no change │
│ QQuery 2  │  98.78 ms │              98.51 ms │     no change │
│ QQuery 3  │ 134.27 ms │             133.28 ms │     no change │
│ QQuery 4  │  83.94 ms │              83.13 ms │     no change │
│ QQuery 5  │ 198.67 ms │             186.29 ms │ +1.07x faster │
│ QQuery 6  │  71.88 ms │              70.70 ms │     no change │
│ QQuery 7  │ 231.82 ms │             229.11 ms │     no change │
│ QQuery 8  │ 189.48 ms │             189.00 ms │     no change │
│ QQuery 9  │ 234.70 ms │             246.50 ms │  1.05x slower │
│ QQuery 10 │ 210.10 ms │             196.58 ms │ +1.07x faster │
│ QQuery 11 │  68.86 ms │              71.57 ms │     no change │
│ QQuery 12 │ 130.09 ms │             125.86 ms │     no change │
│ QQuery 13 │ 250.83 ms │             257.70 ms │     no change │
│ QQuery 14 │  96.33 ms │              97.14 ms │     no change │
│ QQuery 15 │ 132.75 ms │             122.56 ms │ +1.08x faster │
│ QQuery 16 │  69.84 ms │              62.81 ms │ +1.11x faster │
│ QQuery 17 │ 310.09 ms │             327.58 ms │  1.06x slower │
│ QQuery 18 │ 349.72 ms │             342.98 ms │     no change │
│ QQuery 19 │ 142.04 ms │             146.58 ms │     no change │
│ QQuery 20 │ 143.24 ms │             146.93 ms │     no change │
│ QQuery 21 │ 290.00 ms │             269.21 ms │ +1.08x faster │
│ QQuery 22 │  45.48 ms │              43.03 ms │ +1.06x faster │
└───────────┴───────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃           ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 3676.30ms │
│ Total Time (alamb_update_arrow_58)   │ 3643.64ms │
│ Average Time (HEAD)                  │  167.10ms │
│ Average Time (alamb_update_arrow_58) │  165.62ms │
│ Queries Faster                       │         6 │
│ Queries Slower                       │         2 │
│ Queries with No Change               │        14 │
│ Queries with Failure                 │         0 │
└──────────────────────────────────────┴───────────┘

alamb-ghbot · 2026-01-22T23:11:21Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (917a464) to 3d90d4b diff using: tpcds
Results will be posted here when complete

alamb-ghbot · 2026-01-22T23:20:22Z

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow_58
--------------------
Benchmark tpcds_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃        HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │    79.17 ms │              72.13 ms │ +1.10x faster │
│ QQuery 2  │   224.81 ms │             228.18 ms │     no change │
│ QQuery 3  │   171.37 ms │             161.58 ms │ +1.06x faster │
│ QQuery 4  │  2040.88 ms │            1918.36 ms │ +1.06x faster │
│ QQuery 5  │   289.91 ms │             298.35 ms │     no change │
│ QQuery 6  │  1460.01 ms │            1401.32 ms │     no change │
│ QQuery 7  │   514.02 ms │             508.80 ms │     no change │
│ QQuery 8  │   171.94 ms │             180.89 ms │  1.05x slower │
│ QQuery 9  │   295.68 ms │             305.42 ms │     no change │
│ QQuery 10 │   188.58 ms │             177.19 ms │ +1.06x faster │
│ QQuery 11 │  1337.98 ms │            1312.18 ms │     no change │
│ QQuery 12 │    73.74 ms │              67.64 ms │ +1.09x faster │
│ QQuery 13 │   545.15 ms │             568.00 ms │     no change │
│ QQuery 14 │  2118.58 ms │            1898.22 ms │ +1.12x faster │
│ QQuery 15 │    33.97 ms │              32.62 ms │     no change │
│ QQuery 16 │    70.45 ms │              67.56 ms │     no change │
│ QQuery 17 │   394.71 ms │             377.08 ms │     no change │
│ QQuery 18 │   214.39 ms │             193.27 ms │ +1.11x faster │
│ QQuery 19 │   259.56 ms │             237.58 ms │ +1.09x faster │
│ QQuery 20 │    30.57 ms │              26.61 ms │ +1.15x faster │
│ QQuery 21 │    45.99 ms │              39.30 ms │ +1.17x faster │
│ QQuery 22 │   927.81 ms │             713.58 ms │ +1.30x faster │
│ QQuery 23 │  1864.28 ms │            1788.57 ms │     no change │
│ QQuery 24 │   754.24 ms │             677.58 ms │ +1.11x faster │
│ QQuery 25 │   588.96 ms │             533.28 ms │ +1.10x faster │
│ QQuery 26 │   142.88 ms │             131.28 ms │ +1.09x faster │
│ QQuery 27 │   520.84 ms │             507.79 ms │     no change │
│ QQuery 28 │   306.60 ms │             314.30 ms │     no change │
│ QQuery 29 │   510.50 ms │             469.93 ms │ +1.09x faster │
│ QQuery 30 │    76.99 ms │              75.50 ms │     no change │
│ QQuery 31 │   345.08 ms │             314.48 ms │ +1.10x faster │
│ QQuery 32 │    90.96 ms │              84.56 ms │ +1.08x faster │
│ QQuery 33 │   230.01 ms │             213.80 ms │ +1.08x faster │
│ QQuery 34 │   178.65 ms │             167.05 ms │ +1.07x faster │
│ QQuery 35 │   183.96 ms │             169.88 ms │ +1.08x faster │
│ QQuery 36 │   313.61 ms │             284.46 ms │ +1.10x faster │
│ QQuery 37 │   257.32 ms │             253.15 ms │     no change │
│ QQuery 38 │   160.53 ms │             150.73 ms │ +1.07x faster │
│ QQuery 39 │   224.72 ms │             209.81 ms │ +1.07x faster │
│ QQuery 40 │   182.10 ms │             180.77 ms │     no change │
│ QQuery 41 │    25.81 ms │              25.08 ms │     no change │
│ QQuery 42 │   145.05 ms │             148.56 ms │     no change │
│ QQuery 43 │   127.77 ms │             128.90 ms │     no change │
│ QQuery 44 │    30.31 ms │              29.60 ms │     no change │
│ QQuery 45 │    92.62 ms │              91.61 ms │     no change │
│ QQuery 46 │   328.09 ms │             330.78 ms │     no change │
│ QQuery 47 │  1104.12 ms │            1094.38 ms │     no change │
│ QQuery 48 │   415.01 ms │             429.66 ms │     no change │
│ QQuery 49 │   379.51 ms │             381.70 ms │     no change │
│ QQuery 50 │   359.82 ms │             359.83 ms │     no change │
│ QQuery 51 │   306.24 ms │             306.73 ms │     no change │
│ QQuery 52 │   144.57 ms │             149.33 ms │     no change │
│ QQuery 53 │   157.22 ms │             152.68 ms │     no change │
│ QQuery 54 │   225.78 ms │             226.70 ms │     no change │
│ QQuery 55 │   143.56 ms │             148.20 ms │     no change │
│ QQuery 56 │   206.67 ms │             211.96 ms │     no change │
│ QQuery 57 │   302.41 ms │             301.17 ms │     no change │
│ QQuery 58 │   495.64 ms │             505.79 ms │     no change │
│ QQuery 59 │   291.72 ms │             306.31 ms │     no change │
│ QQuery 60 │   212.72 ms │             220.52 ms │     no change │
│ QQuery 61 │   248.55 ms │             254.88 ms │     no change │
│ QQuery 62 │  1324.55 ms │            1368.58 ms │     no change │
│ QQuery 63 │   153.67 ms │             153.88 ms │     no change │
│ QQuery 64 │  1198.30 ms │            1184.27 ms │     no change │
│ QQuery 65 │   357.24 ms │             373.48 ms │     no change │
│ QQuery 66 │   387.18 ms │             407.87 ms │  1.05x slower │
│ QQuery 67 │   542.00 ms │             535.13 ms │     no change │
│ QQuery 68 │   376.17 ms │             408.70 ms │  1.09x slower │
│ QQuery 69 │   172.90 ms │             174.04 ms │     no change │
│ QQuery 70 │   494.97 ms │             516.26 ms │     no change │
│ QQuery 71 │   186.93 ms │             191.43 ms │     no change │
│ QQuery 72 │  2182.50 ms │            2039.71 ms │ +1.07x faster │
│ QQuery 73 │   159.12 ms │             161.68 ms │     no change │
│ QQuery 74 │   846.88 ms │             868.56 ms │     no change │
│ QQuery 75 │   410.61 ms │             423.13 ms │     no change │
│ QQuery 76 │   186.54 ms │             198.93 ms │  1.07x slower │
│ QQuery 77 │   291.07 ms │             300.90 ms │     no change │
│ QQuery 78 │   975.31 ms │             991.39 ms │     no change │
│ QQuery 79 │   335.07 ms │             359.04 ms │  1.07x slower │
│ QQuery 80 │   522.18 ms │             534.61 ms │     no change │
│ QQuery 81 │    53.37 ms │              52.77 ms │     no change │
│ QQuery 82 │   285.59 ms │             290.82 ms │     no change │
│ QQuery 83 │    82.45 ms │              87.71 ms │  1.06x slower │
│ QQuery 84 │    68.89 ms │              67.42 ms │     no change │
│ QQuery 85 │   228.86 ms │             229.72 ms │     no change │
│ QQuery 86 │    58.98 ms │              64.59 ms │  1.10x slower │
│ QQuery 87 │   154.38 ms │             170.18 ms │  1.10x slower │
│ QQuery 88 │   268.80 ms │             326.59 ms │  1.21x slower │
│ QQuery 89 │   178.99 ms │             177.24 ms │     no change │
│ QQuery 90 │    47.07 ms │              53.23 ms │  1.13x slower │
│ QQuery 91 │    98.40 ms │             103.11 ms │     no change │
│ QQuery 92 │    84.36 ms │              90.02 ms │  1.07x slower │
│ QQuery 93 │   280.19 ms │             297.01 ms │  1.06x slower │
│ QQuery 94 │    93.07 ms │              99.01 ms │  1.06x slower │
│ QQuery 95 │   253.23 ms │             261.02 ms │     no change │
│ QQuery 96 │   114.45 ms │             122.23 ms │  1.07x slower │
│ QQuery 97 │   198.32 ms │             207.24 ms │     no change │
│ QQuery 98 │   220.35 ms │             251.65 ms │  1.14x slower │
│ QQuery 99 │ 14039.03 ms │           15908.20 ms │  1.13x slower │
└───────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 52076.67ms │
│ Total Time (alamb_update_arrow_58)   │ 53168.51ms │
│ Average Time (HEAD)                  │   526.03ms │
│ Average Time (alamb_update_arrow_58) │   537.06ms │
│ Queries Faster                       │         24 │
│ Queries Slower                       │         16 │
│ Queries with No Change               │         59 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘

alamb-ghbot · 2026-01-22T23:20:24Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (917a464) to 3d90d4b diff using: clickbench_partitioned
Results will be posted here when complete

alamb-ghbot · 2026-01-22T23:37:33Z

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow_58
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃        HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0  │     1.97 ms │               2.04 ms │     no change │
│ QQuery 1  │    52.37 ms │              51.82 ms │     no change │
│ QQuery 2  │   137.51 ms │             151.27 ms │  1.10x slower │
│ QQuery 3  │   150.92 ms │             160.93 ms │  1.07x slower │
│ QQuery 4  │  1219.23 ms │            1102.33 ms │ +1.11x faster │
│ QQuery 5  │  1494.41 ms │            1417.99 ms │ +1.05x faster │
│ QQuery 6  │     1.88 ms │               1.89 ms │     no change │
│ QQuery 7  │    57.37 ms │              54.63 ms │     no change │
│ QQuery 8  │  1607.06 ms │            1425.69 ms │ +1.13x faster │
│ QQuery 9  │  1886.76 ms │            1863.70 ms │     no change │
│ QQuery 10 │   362.17 ms │             349.69 ms │     no change │
│ QQuery 11 │   425.29 ms │             400.69 ms │ +1.06x faster │
│ QQuery 12 │  1414.73 ms │            1289.08 ms │ +1.10x faster │
│ QQuery 13 │  2127.10 ms │            1945.61 ms │ +1.09x faster │
│ QQuery 14 │  1342.07 ms │            1240.77 ms │ +1.08x faster │
│ QQuery 15 │  1315.78 ms │            1226.55 ms │ +1.07x faster │
│ QQuery 16 │  2630.35 ms │            2505.80 ms │     no change │
│ QQuery 17 │  2585.81 ms │            2515.49 ms │     no change │
│ QQuery 18 │  5586.44 ms │            4900.68 ms │ +1.14x faster │
│ QQuery 19 │   127.33 ms │             122.68 ms │     no change │
│ QQuery 20 │  1990.77 ms │            1906.59 ms │     no change │
│ QQuery 21 │  2276.17 ms │            2197.36 ms │     no change │
│ QQuery 22 │  3868.87 ms │            3816.53 ms │     no change │
│ QQuery 23 │ 16138.11 ms │           12016.17 ms │ +1.34x faster │
│ QQuery 24 │   226.05 ms │             229.70 ms │     no change │
│ QQuery 25 │   486.82 ms │             459.64 ms │ +1.06x faster │
│ QQuery 26 │   233.35 ms │             223.34 ms │     no change │
│ QQuery 27 │  2759.45 ms │            2725.31 ms │     no change │
│ QQuery 28 │ 23880.13 ms │           21924.91 ms │ +1.09x faster │
│ QQuery 29 │   948.47 ms │             959.76 ms │     no change │
│ QQuery 30 │  1390.50 ms │            1270.31 ms │ +1.09x faster │
│ QQuery 31 │  1414.50 ms │            1343.97 ms │     no change │
│ QQuery 32 │  4525.98 ms │            4046.00 ms │ +1.12x faster │
│ QQuery 33 │  5951.65 ms │            5522.24 ms │ +1.08x faster │
│ QQuery 34 │  6113.97 ms │            5670.06 ms │ +1.08x faster │
│ QQuery 35 │  2172.77 ms │            1875.97 ms │ +1.16x faster │
│ QQuery 36 │    69.21 ms │              69.48 ms │     no change │
│ QQuery 37 │    46.12 ms │              46.37 ms │     no change │
│ QQuery 38 │    69.09 ms │              66.58 ms │     no change │
│ QQuery 39 │   107.01 ms │             103.83 ms │     no change │
│ QQuery 40 │    28.27 ms │              27.38 ms │     no change │
│ QQuery 41 │    24.03 ms │              25.85 ms │  1.08x slower │
│ QQuery 42 │    21.95 ms │              21.76 ms │     no change │
└───────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 99269.79ms │
│ Total Time (alamb_update_arrow_58)   │ 89278.41ms │
│ Average Time (HEAD)                  │  2308.60ms │
│ Average Time (alamb_update_arrow_58) │  2076.24ms │
│ Queries Faster                       │         17 │
│ Queries Slower                       │          3 │
│ Queries with No Change               │         23 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘

Dandandan · 2026-01-23T16:22:39Z

run benchmark tpch tpcds clickbench_partitioned

alamb-ghbot · 2026-01-23T16:22:49Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (917a464) to 3d90d4b diff using: tpch
Results will be posted here when complete

alamb-ghbot · 2026-01-23T16:23:27Z

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow_58
--------------------
Benchmark tpch_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃      HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │ 181.51 ms │             179.34 ms │     no change │
│ QQuery 2  │  87.31 ms │              86.49 ms │     no change │
│ QQuery 3  │ 125.91 ms │             118.91 ms │ +1.06x faster │
│ QQuery 4  │  77.54 ms │              79.75 ms │     no change │
│ QQuery 5  │ 177.11 ms │             162.40 ms │ +1.09x faster │
│ QQuery 6  │  66.04 ms │              67.15 ms │     no change │
│ QQuery 7  │ 209.22 ms │             203.00 ms │     no change │
│ QQuery 8  │ 171.39 ms │             167.16 ms │     no change │
│ QQuery 9  │ 235.94 ms │             226.76 ms │     no change │
│ QQuery 10 │ 189.92 ms │             178.53 ms │ +1.06x faster │
│ QQuery 11 │  63.17 ms │              62.36 ms │     no change │
│ QQuery 12 │ 119.76 ms │             117.38 ms │     no change │
│ QQuery 13 │ 218.91 ms │             223.29 ms │     no change │
│ QQuery 14 │  90.38 ms │              97.30 ms │  1.08x slower │
│ QQuery 15 │ 126.79 ms │             123.45 ms │     no change │
│ QQuery 16 │  61.91 ms │              60.76 ms │     no change │
│ QQuery 17 │ 264.97 ms │             283.36 ms │  1.07x slower │
│ QQuery 18 │ 315.12 ms │             302.13 ms │     no change │
│ QQuery 19 │ 137.94 ms │             131.76 ms │     no change │
│ QQuery 20 │ 132.20 ms │             133.09 ms │     no change │
│ QQuery 21 │ 262.88 ms │             245.70 ms │ +1.07x faster │
│ QQuery 22 │  39.93 ms │              40.37 ms │     no change │
└───────────┴───────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃           ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 3355.85ms │
│ Total Time (alamb_update_arrow_58)   │ 3290.45ms │
│ Average Time (HEAD)                  │  152.54ms │
│ Average Time (alamb_update_arrow_58) │  149.57ms │
│ Queries Faster                       │         4 │
│ Queries Slower                       │         2 │
│ Queries with No Change               │        16 │
│ Queries with Failure                 │         0 │
└──────────────────────────────────────┴───────────┘

alamb-ghbot · 2026-01-23T16:23:30Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (917a464) to 3d90d4b diff using: tpcds
Results will be posted here when complete

Dandandan · 2026-01-23T16:28:24Z

run benchmark tpch tpcds clickbench_partitioned tpch_mem

alamb-ghbot · 2026-01-23T16:32:12Z

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow_58
--------------------
Benchmark tpcds_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃        HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │    70.89 ms │              73.36 ms │     no change │
│ QQuery 2  │   208.58 ms │             223.44 ms │  1.07x slower │
│ QQuery 3  │   159.02 ms │             162.57 ms │     no change │
│ QQuery 4  │  1878.02 ms │            1833.84 ms │     no change │
│ QQuery 5  │   283.63 ms │             287.15 ms │     no change │
│ QQuery 6  │  1436.06 ms │            1461.34 ms │     no change │
│ QQuery 7  │   506.23 ms │             499.29 ms │     no change │
│ QQuery 8  │   173.33 ms │             175.81 ms │     no change │
│ QQuery 9  │   286.80 ms │             292.73 ms │     no change │
│ QQuery 10 │   176.84 ms │             172.01 ms │     no change │
│ QQuery 11 │  1259.82 ms │            1255.82 ms │     no change │
│ QQuery 12 │    69.80 ms │              68.47 ms │     no change │
│ QQuery 13 │   530.65 ms │             554.62 ms │     no change │
│ QQuery 14 │  1857.29 ms │            1876.88 ms │     no change │
│ QQuery 15 │    32.28 ms │              31.78 ms │     no change │
│ QQuery 16 │    65.92 ms │              66.20 ms │     no change │
│ QQuery 17 │   369.95 ms │             374.87 ms │     no change │
│ QQuery 18 │   196.57 ms │             191.01 ms │     no change │
│ QQuery 19 │   231.02 ms │             235.58 ms │     no change │
│ QQuery 20 │    26.17 ms │              25.87 ms │     no change │
│ QQuery 21 │    40.13 ms │              38.97 ms │     no change │
│ QQuery 22 │   703.73 ms │             706.99 ms │     no change │
│ QQuery 23 │  1762.77 ms │            1737.51 ms │     no change │
│ QQuery 24 │   693.83 ms │             708.71 ms │     no change │
│ QQuery 25 │   540.88 ms │             532.89 ms │     no change │
│ QQuery 26 │   130.02 ms │             126.55 ms │     no change │
│ QQuery 27 │   508.70 ms │             497.50 ms │     no change │
│ QQuery 28 │   283.49 ms │             307.75 ms │  1.09x slower │
│ QQuery 29 │   455.23 ms │             465.88 ms │     no change │
│ QQuery 30 │    75.64 ms │              72.32 ms │     no change │
│ QQuery 31 │   304.54 ms │             304.88 ms │     no change │
│ QQuery 32 │    84.88 ms │              86.43 ms │     no change │
│ QQuery 33 │   205.39 ms │             208.98 ms │     no change │
│ QQuery 34 │   161.24 ms │             162.09 ms │     no change │
│ QQuery 35 │   176.79 ms │             166.92 ms │ +1.06x faster │
│ QQuery 36 │   280.80 ms │             285.08 ms │     no change │
│ QQuery 37 │   254.09 ms │             248.41 ms │     no change │
│ QQuery 38 │   146.59 ms │             151.07 ms │     no change │
│ QQuery 39 │   213.09 ms │             202.43 ms │ +1.05x faster │
│ QQuery 40 │   178.30 ms │             175.49 ms │     no change │
│ QQuery 41 │    24.26 ms │              23.87 ms │     no change │
│ QQuery 42 │   141.68 ms │             146.48 ms │     no change │
│ QQuery 43 │   125.01 ms │             127.22 ms │     no change │
│ QQuery 44 │    28.33 ms │              29.04 ms │     no change │
│ QQuery 45 │    90.77 ms │              88.48 ms │     no change │
│ QQuery 46 │   319.08 ms │             323.57 ms │     no change │
│ QQuery 47 │  1039.36 ms │            1033.56 ms │     no change │
│ QQuery 48 │   398.71 ms │             417.29 ms │     no change │
│ QQuery 49 │   373.95 ms │             381.51 ms │     no change │
│ QQuery 50 │   347.88 ms │             357.03 ms │     no change │
│ QQuery 51 │   303.52 ms │             296.03 ms │     no change │
│ QQuery 52 │   141.53 ms │             148.44 ms │     no change │
│ QQuery 53 │   150.87 ms │             152.57 ms │     no change │
│ QQuery 54 │   216.48 ms │             229.75 ms │  1.06x slower │
│ QQuery 55 │   142.98 ms │             148.94 ms │     no change │
│ QQuery 56 │   206.22 ms │             213.05 ms │     no change │
│ QQuery 57 │   293.57 ms │             289.75 ms │     no change │
│ QQuery 58 │   484.64 ms │             496.91 ms │     no change │
│ QQuery 59 │   283.06 ms │             298.98 ms │  1.06x slower │
│ QQuery 60 │   211.17 ms │             214.21 ms │     no change │
│ QQuery 61 │   246.31 ms │             248.85 ms │     no change │
│ QQuery 62 │  1248.56 ms │            1396.75 ms │  1.12x slower │
│ QQuery 63 │   151.45 ms │             152.26 ms │     no change │
│ QQuery 64 │  1189.06 ms │            1164.66 ms │     no change │
│ QQuery 65 │   346.12 ms │             350.82 ms │     no change │
│ QQuery 66 │   378.28 ms │             387.58 ms │     no change │
│ QQuery 67 │   528.15 ms │             526.71 ms │     no change │
│ QQuery 68 │   371.14 ms │             383.67 ms │     no change │
│ QQuery 69 │   168.41 ms │             167.51 ms │     no change │
│ QQuery 70 │   480.86 ms │             509.82 ms │  1.06x slower │
│ QQuery 71 │   184.50 ms │             188.60 ms │     no change │
│ QQuery 72 │  2111.10 ms │            2031.73 ms │     no change │
│ QQuery 73 │   158.20 ms │             157.95 ms │     no change │
│ QQuery 74 │   778.75 ms │             800.47 ms │     no change │
│ QQuery 75 │   410.75 ms │             398.84 ms │     no change │
│ QQuery 76 │   185.86 ms │             189.46 ms │     no change │
│ QQuery 77 │   284.82 ms │             296.16 ms │     no change │
│ QQuery 78 │   954.48 ms │             921.77 ms │     no change │
│ QQuery 79 │   318.74 ms │             324.85 ms │     no change │
│ QQuery 80 │   522.82 ms │             510.62 ms │     no change │
│ QQuery 81 │    52.21 ms │              48.85 ms │ +1.07x faster │
│ QQuery 82 │   284.07 ms │             283.49 ms │     no change │
│ QQuery 83 │    81.57 ms │              82.05 ms │     no change │
│ QQuery 84 │    68.80 ms │              64.39 ms │ +1.07x faster │
│ QQuery 85 │   227.20 ms │             218.56 ms │     no change │
│ QQuery 86 │    58.88 ms │              58.41 ms │     no change │
│ QQuery 87 │   153.18 ms │             148.74 ms │     no change │
│ QQuery 88 │   269.18 ms │             270.27 ms │     no change │
│ QQuery 89 │   170.65 ms │             170.89 ms │     no change │
│ QQuery 90 │    45.44 ms │              45.96 ms │     no change │
│ QQuery 91 │    97.61 ms │             100.59 ms │     no change │
│ QQuery 92 │    82.47 ms │              84.55 ms │     no change │
│ QQuery 93 │   274.75 ms │             271.99 ms │     no change │
│ QQuery 94 │    92.78 ms │              94.25 ms │     no change │
│ QQuery 95 │   249.74 ms │             248.42 ms │     no change │
│ QQuery 96 │   114.45 ms │             116.29 ms │     no change │
│ QQuery 97 │   194.47 ms │             194.24 ms │     no change │
│ QQuery 98 │   216.05 ms │             209.70 ms │     no change │
│ QQuery 99 │ 13929.63 ms │           15742.39 ms │  1.13x slower │
└───────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 50023.61ms │
│ Total Time (alamb_update_arrow_58)   │ 52029.28ms │
│ Average Time (HEAD)                  │   505.29ms │
│ Average Time (alamb_update_arrow_58) │   525.55ms │
│ Queries Faster                       │          4 │
│ Queries Slower                       │          7 │
│ Queries with No Change               │         88 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘

alamb-ghbot · 2026-01-23T16:32:15Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (1b979c6) to 3d90d4b diff using: clickbench_partitioned
Results will be posted here when complete

alamb-ghbot · 2026-01-23T17:03:04Z

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow_58
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃        HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0  │     1.96 ms │               2.03 ms │     no change │
│ QQuery 1  │    52.93 ms │              51.54 ms │     no change │
│ QQuery 2  │   131.25 ms │             154.81 ms │  1.18x slower │
│ QQuery 3  │   155.24 ms │             155.67 ms │     no change │
│ QQuery 4  │  1084.50 ms │            1215.12 ms │  1.12x slower │
│ QQuery 5  │  1392.70 ms │            1578.99 ms │  1.13x slower │
│ QQuery 6  │     1.91 ms │               1.92 ms │     no change │
│ QQuery 7  │    56.66 ms │              57.34 ms │     no change │
│ QQuery 8  │  1455.65 ms │            1582.96 ms │  1.09x slower │
│ QQuery 9  │  1834.61 ms │            1915.50 ms │     no change │
│ QQuery 10 │   347.77 ms │             327.55 ms │ +1.06x faster │
│ QQuery 11 │   409.15 ms │             369.64 ms │ +1.11x faster │
│ QQuery 12 │  1313.13 ms │            1495.53 ms │  1.14x slower │
│ QQuery 13 │  1994.00 ms │            2193.24 ms │  1.10x slower │
│ QQuery 14 │  1258.90 ms │            1353.70 ms │  1.08x slower │
│ QQuery 15 │  1238.38 ms │            1413.01 ms │  1.14x slower │
│ QQuery 16 │  2596.55 ms │            2745.77 ms │  1.06x slower │
│ QQuery 17 │  2542.34 ms │            2738.10 ms │  1.08x slower │
│ QQuery 18 │  5077.51 ms │            4911.44 ms │     no change │
│ QQuery 19 │   120.89 ms │             124.13 ms │     no change │
│ QQuery 20 │  1904.24 ms │            1858.24 ms │     no change │
│ QQuery 21 │  2265.06 ms │            2151.60 ms │ +1.05x faster │
│ QQuery 22 │  3859.18 ms │            3716.75 ms │     no change │
│ QQuery 23 │ 12208.56 ms │           11679.20 ms │     no change │
│ QQuery 24 │   201.50 ms │             201.08 ms │     no change │
│ QQuery 25 │   475.46 ms │             458.38 ms │     no change │
│ QQuery 26 │   216.13 ms │             215.28 ms │     no change │
│ QQuery 27 │  2696.81 ms │            2729.36 ms │     no change │
│ QQuery 28 │ 23518.30 ms │           23401.06 ms │     no change │
│ QQuery 29 │   973.01 ms │            1002.12 ms │     no change │
│ QQuery 30 │  1299.13 ms │            1306.09 ms │     no change │
│ QQuery 31 │  1369.66 ms │            1351.17 ms │     no change │
│ QQuery 32 │  4429.52 ms │            4281.05 ms │     no change │
│ QQuery 33 │  5544.15 ms │            5677.97 ms │     no change │
│ QQuery 34 │  5674.17 ms │            5975.90 ms │  1.05x slower │
│ QQuery 35 │  1974.89 ms │            2146.54 ms │  1.09x slower │
│ QQuery 36 │    67.99 ms │              70.84 ms │     no change │
│ QQuery 37 │    47.81 ms │              46.18 ms │     no change │
│ QQuery 38 │    66.25 ms │              73.43 ms │  1.11x slower │
│ QQuery 39 │   108.59 ms │             106.50 ms │     no change │
│ QQuery 40 │    27.99 ms │              28.42 ms │     no change │
│ QQuery 41 │    25.11 ms │              25.99 ms │     no change │
│ QQuery 42 │    21.79 ms │              21.30 ms │     no change │
└───────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 92041.34ms │
│ Total Time (alamb_update_arrow_58)   │ 92912.47ms │
│ Average Time (HEAD)                  │  2140.50ms │
│ Average Time (alamb_update_arrow_58) │  2160.76ms │
│ Queries Faster                       │          3 │
│ Queries Slower                       │         13 │
│ Queries with No Change               │         27 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘

alamb-ghbot · 2026-01-23T17:03:08Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (1b979c6) to 3d90d4b diff using: tpch
Results will be posted here when complete

alamb-ghbot · 2026-01-23T17:03:48Z

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow_58
--------------------
Benchmark tpch_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃      HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │ 183.18 ms │             175.92 ms │     no change │
│ QQuery 2  │  97.14 ms │              91.48 ms │ +1.06x faster │
│ QQuery 3  │ 131.33 ms │             123.68 ms │ +1.06x faster │
│ QQuery 4  │  80.51 ms │              76.50 ms │     no change │
│ QQuery 5  │ 182.64 ms │             168.69 ms │ +1.08x faster │
│ QQuery 6  │  68.88 ms │              68.98 ms │     no change │
│ QQuery 7  │ 216.12 ms │             206.25 ms │     no change │
│ QQuery 8  │ 175.70 ms │             178.22 ms │     no change │
│ QQuery 9  │ 247.62 ms │             232.89 ms │ +1.06x faster │
│ QQuery 10 │ 196.47 ms │             188.84 ms │     no change │
│ QQuery 11 │  64.61 ms │              68.04 ms │  1.05x slower │
│ QQuery 12 │ 124.08 ms │             120.04 ms │     no change │
│ QQuery 13 │ 227.01 ms │             227.07 ms │     no change │
│ QQuery 14 │  90.41 ms │              95.78 ms │  1.06x slower │
│ QQuery 15 │ 127.78 ms │             129.01 ms │     no change │
│ QQuery 16 │  64.00 ms │              63.02 ms │     no change │
│ QQuery 17 │ 276.36 ms │             296.78 ms │  1.07x slower │
│ QQuery 18 │ 323.91 ms │             308.95 ms │     no change │
│ QQuery 19 │ 140.03 ms │             133.75 ms │     no change │
│ QQuery 20 │ 136.63 ms │             130.62 ms │     no change │
│ QQuery 21 │ 265.93 ms │             257.31 ms │     no change │
│ QQuery 22 │  42.71 ms │              42.54 ms │     no change │
└───────────┴───────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃           ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 3463.04ms │
│ Total Time (alamb_update_arrow_58)   │ 3384.37ms │
│ Average Time (HEAD)                  │  157.41ms │
│ Average Time (alamb_update_arrow_58) │  153.83ms │
│ Queries Faster                       │         4 │
│ Queries Slower                       │         3 │
│ Queries with No Change               │        15 │
│ Queries with Failure                 │         0 │
└──────────────────────────────────────┴───────────┘

alamb-ghbot · 2026-01-23T17:03:50Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (1b979c6) to 3d90d4b diff using: tpcds
Results will be posted here when complete

alamb-ghbot · 2026-01-23T17:12:47Z

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow_58
--------------------
Benchmark tpcds_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃        HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │    73.75 ms │              73.05 ms │     no change │
│ QQuery 2  │   213.50 ms │             259.16 ms │  1.21x slower │
│ QQuery 3  │   162.14 ms │             162.05 ms │     no change │
│ QQuery 4  │  2027.69 ms │            1944.08 ms │     no change │
│ QQuery 5  │   287.07 ms │             287.84 ms │     no change │
│ QQuery 6  │  1425.94 ms │            1497.77 ms │  1.05x slower │
│ QQuery 7  │   519.67 ms │             501.59 ms │     no change │
│ QQuery 8  │   176.50 ms │             180.00 ms │     no change │
│ QQuery 9  │   285.16 ms │             316.15 ms │  1.11x slower │
│ QQuery 10 │   182.76 ms │             169.21 ms │ +1.08x faster │
│ QQuery 11 │  1354.33 ms │            1332.58 ms │     no change │
│ QQuery 12 │    70.93 ms │              73.54 ms │     no change │
│ QQuery 13 │   549.42 ms │             587.74 ms │  1.07x slower │
│ QQuery 14 │  1909.02 ms │            1930.63 ms │     no change │
│ QQuery 15 │    33.26 ms │              33.32 ms │     no change │
│ QQuery 16 │    66.65 ms │              67.20 ms │     no change │
│ QQuery 17 │   377.85 ms │             381.71 ms │     no change │
│ QQuery 18 │   201.64 ms │             187.99 ms │ +1.07x faster │
│ QQuery 19 │   238.15 ms │             242.18 ms │     no change │
│ QQuery 20 │    29.31 ms │              25.77 ms │ +1.14x faster │
│ QQuery 21 │    42.55 ms │              40.26 ms │ +1.06x faster │
│ QQuery 22 │   732.48 ms │             730.08 ms │     no change │
│ QQuery 23 │  1815.58 ms │            1851.76 ms │     no change │
│ QQuery 24 │   698.30 ms │             685.94 ms │     no change │
│ QQuery 25 │   538.49 ms │             536.28 ms │     no change │
│ QQuery 26 │   131.66 ms │             128.98 ms │     no change │
│ QQuery 27 │   510.91 ms │             512.74 ms │     no change │
│ QQuery 28 │   304.54 ms │             319.85 ms │  1.05x slower │
│ QQuery 29 │   469.70 ms │             473.39 ms │     no change │
│ QQuery 30 │    75.33 ms │              71.82 ms │     no change │
│ QQuery 31 │   309.99 ms │             310.37 ms │     no change │
│ QQuery 32 │    86.15 ms │              87.18 ms │     no change │
│ QQuery 33 │   208.90 ms │             210.81 ms │     no change │
│ QQuery 34 │   167.08 ms │             164.06 ms │     no change │
│ QQuery 35 │   181.98 ms │             173.32 ms │     no change │
│ QQuery 36 │   280.25 ms │             290.52 ms │     no change │
│ QQuery 37 │   259.64 ms │             255.21 ms │     no change │
│ QQuery 38 │   152.42 ms │             146.21 ms │     no change │
│ QQuery 39 │   222.37 ms │             219.00 ms │     no change │
│ QQuery 40 │   176.32 ms │             181.07 ms │     no change │
│ QQuery 41 │    25.29 ms │              25.70 ms │     no change │
│ QQuery 42 │   145.13 ms │             146.23 ms │     no change │
│ QQuery 43 │   126.98 ms │             128.81 ms │     no change │
│ QQuery 44 │    30.07 ms │              29.93 ms │     no change │
│ QQuery 45 │    93.00 ms │              90.15 ms │     no change │
│ QQuery 46 │   338.47 ms │             341.63 ms │     no change │
│ QQuery 47 │  1174.23 ms │            1106.45 ms │ +1.06x faster │
│ QQuery 48 │   421.39 ms │             432.32 ms │     no change │
│ QQuery 49 │   377.28 ms │             382.91 ms │     no change │
│ QQuery 50 │   365.49 ms │             361.92 ms │     no change │
│ QQuery 51 │   310.50 ms │             311.20 ms │     no change │
│ QQuery 52 │   146.33 ms │             148.53 ms │     no change │
│ QQuery 53 │   153.67 ms │             155.65 ms │     no change │
│ QQuery 54 │   225.43 ms │             225.82 ms │     no change │
│ QQuery 55 │   145.37 ms │             147.12 ms │     no change │
│ QQuery 56 │   215.98 ms │             211.68 ms │     no change │
│ QQuery 57 │   307.47 ms │             296.10 ms │     no change │
│ QQuery 58 │   518.77 ms │             495.84 ms │     no change │
│ QQuery 59 │   293.94 ms │             351.01 ms │  1.19x slower │
│ QQuery 60 │   215.35 ms │             215.36 ms │     no change │
│ QQuery 61 │   250.37 ms │             247.21 ms │     no change │
│ QQuery 62 │  1349.91 ms │            1387.55 ms │     no change │
│ QQuery 63 │   159.45 ms │             156.84 ms │     no change │
│ QQuery 64 │  1201.21 ms │            1197.90 ms │     no change │
│ QQuery 65 │   366.26 ms │             369.20 ms │     no change │
│ QQuery 66 │   399.78 ms │             387.45 ms │     no change │
│ QQuery 67 │   555.69 ms │             547.44 ms │     no change │
│ QQuery 68 │   384.56 ms │             399.65 ms │     no change │
│ QQuery 69 │   175.08 ms │             164.36 ms │ +1.07x faster │
│ QQuery 70 │   500.70 ms │             499.18 ms │     no change │
│ QQuery 71 │   185.54 ms │             191.86 ms │     no change │
│ QQuery 72 │  2209.32 ms │            2082.22 ms │ +1.06x faster │
│ QQuery 73 │   156.70 ms │             166.85 ms │  1.06x slower │
│ QQuery 74 │   861.55 ms │             857.13 ms │     no change │
│ QQuery 75 │   409.39 ms │             424.61 ms │     no change │
│ QQuery 76 │   189.27 ms │             189.41 ms │     no change │
│ QQuery 77 │   290.53 ms │             292.70 ms │     no change │
│ QQuery 78 │   978.73 ms │             935.82 ms │     no change │
│ QQuery 79 │   351.51 ms │             347.14 ms │     no change │
│ QQuery 80 │   528.75 ms │             522.09 ms │     no change │
│ QQuery 81 │    55.55 ms │              49.92 ms │ +1.11x faster │
│ QQuery 82 │   285.75 ms │             287.48 ms │     no change │
│ QQuery 83 │    85.62 ms │              82.14 ms │     no change │
│ QQuery 84 │    72.00 ms │              65.84 ms │ +1.09x faster │
│ QQuery 85 │   234.35 ms │             214.27 ms │ +1.09x faster │
│ QQuery 86 │    57.82 ms │              58.62 ms │     no change │
│ QQuery 87 │   155.36 ms │             154.72 ms │     no change │
│ QQuery 88 │   271.70 ms │             271.54 ms │     no change │
│ QQuery 89 │   171.52 ms │             174.56 ms │     no change │
│ QQuery 90 │    48.78 ms │              47.09 ms │     no change │
│ QQuery 91 │   103.41 ms │              96.76 ms │ +1.07x faster │
│ QQuery 92 │    85.36 ms │              85.79 ms │     no change │
│ QQuery 93 │   283.27 ms │             289.05 ms │     no change │
│ QQuery 94 │    97.14 ms │              95.27 ms │     no change │
│ QQuery 95 │   258.25 ms │             251.56 ms │     no change │
│ QQuery 96 │   116.28 ms │             118.08 ms │     no change │
│ QQuery 97 │   198.11 ms │             195.96 ms │     no change │
│ QQuery 98 │   227.47 ms │             219.77 ms │     no change │
│ QQuery 99 │ 14133.89 ms │           15770.08 ms │  1.12x slower │
└───────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 51625.49ms │
│ Total Time (alamb_update_arrow_58)   │ 53141.91ms │
│ Average Time (HEAD)                  │   521.47ms │
│ Average Time (alamb_update_arrow_58) │   536.79ms │
│ Queries Faster                       │         11 │
│ Queries Slower                       │          8 │
│ Queries with No Change               │         80 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘

alamb-ghbot · 2026-01-23T17:12:49Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (1b979c6) to 3d90d4b diff using: clickbench_partitioned
Results will be posted here when complete

alamb-ghbot · 2026-01-23T17:29:01Z

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow_58
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃        HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0  │     2.00 ms │               2.01 ms │     no change │
│ QQuery 1  │    52.13 ms │              51.99 ms │     no change │
│ QQuery 2  │   132.54 ms │             149.95 ms │  1.13x slower │
│ QQuery 3  │   155.60 ms │             157.55 ms │     no change │
│ QQuery 4  │  1122.12 ms │            1068.66 ms │     no change │
│ QQuery 5  │  1437.37 ms │            1355.23 ms │ +1.06x faster │
│ QQuery 6  │     1.85 ms │               1.88 ms │     no change │
│ QQuery 7  │    59.83 ms │              56.03 ms │ +1.07x faster │
│ QQuery 8  │  1467.54 ms │            1434.75 ms │     no change │
│ QQuery 9  │  1875.31 ms │            1823.79 ms │     no change │
│ QQuery 10 │   364.09 ms │             330.64 ms │ +1.10x faster │
│ QQuery 11 │   416.29 ms │             374.51 ms │ +1.11x faster │
│ QQuery 12 │  1310.27 ms │            1254.78 ms │     no change │
│ QQuery 13 │  2003.21 ms │            1929.97 ms │     no change │
│ QQuery 14 │  1268.37 ms │            1222.68 ms │     no change │
│ QQuery 15 │  1272.46 ms │            1232.52 ms │     no change │
│ QQuery 16 │  2560.40 ms │            2449.31 ms │     no change │
│ QQuery 17 │  2585.82 ms │            2434.59 ms │ +1.06x faster │
│ QQuery 18 │  4942.52 ms │            4716.86 ms │     no change │
│ QQuery 19 │   121.90 ms │             121.44 ms │     no change │
│ QQuery 20 │  1946.17 ms │            1908.76 ms │     no change │
│ QQuery 21 │  2236.63 ms │            2142.39 ms │     no change │
│ QQuery 22 │  3864.08 ms │            3674.85 ms │     no change │
│ QQuery 23 │ 12322.66 ms │           11467.58 ms │ +1.07x faster │
│ QQuery 24 │   226.05 ms │             197.35 ms │ +1.15x faster │
│ QQuery 25 │   474.36 ms │             445.40 ms │ +1.07x faster │
│ QQuery 26 │   216.42 ms │             203.10 ms │ +1.07x faster │
│ QQuery 27 │  2694.39 ms │            2664.60 ms │     no change │
│ QQuery 28 │ 23640.09 ms │           23298.81 ms │     no change │
│ QQuery 29 │   973.58 ms │             972.33 ms │     no change │
│ QQuery 30 │  1334.87 ms │            1222.64 ms │ +1.09x faster │
│ QQuery 31 │  1336.92 ms │            1290.08 ms │     no change │
│ QQuery 32 │  4241.95 ms │            4180.59 ms │     no change │
│ QQuery 33 │  5696.76 ms │            5589.26 ms │     no change │
│ QQuery 34 │  5705.46 ms │            5649.17 ms │     no change │
│ QQuery 35 │  1966.69 ms │            2027.46 ms │     no change │
│ QQuery 36 │    65.54 ms │              67.58 ms │     no change │
│ QQuery 37 │    46.13 ms │              47.54 ms │     no change │
│ QQuery 38 │    66.82 ms │              68.37 ms │     no change │
│ QQuery 39 │   106.24 ms │             103.53 ms │     no change │
│ QQuery 40 │    28.88 ms │              28.65 ms │     no change │
│ QQuery 41 │    24.31 ms │              25.80 ms │  1.06x slower │
│ QQuery 42 │    20.81 ms │              20.65 ms │     no change │
└───────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 92387.40ms │
│ Total Time (alamb_update_arrow_58)   │ 89465.62ms │
│ Average Time (HEAD)                  │  2148.54ms │
│ Average Time (alamb_update_arrow_58) │  2080.60ms │
│ Queries Faster                       │         10 │
│ Queries Slower                       │          2 │
│ Queries with No Change               │         31 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘

alamb-ghbot · 2026-01-23T17:29:04Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (c3df7be) to 0c82ade diff using: tpch_mem
Results will be posted here when complete

alamb added 10 commits January 6, 2026 17:55

Update to pre-release arrow

120d2b0

Fix clippy due to UnionFields::new is deprecated

40a6a71

Fix real bug in test

f50b9c3

Update test for fixed issue upstream

87563d8

Update tests for new feature

4afd46f

Update tests for struct casting

70e2841

Update to latest

b29b662

Merge remote-tracking branch 'apache/main' into alamb/update_arrow_57…

6a2e631

….2.0

Merge branch 'main' into alamb/update_arrow_57.2.0

ca11966

Update to pre-release main

63a85eb

github-actions bot added sqllogictest SQL Logic Tests (.slt) common Related to common crate proto Related to proto crate functions Changes to functions implementation datasource Changes to the datasource crate physical-plan Changes to the physical-plan crate labels Jan 10, 2026

Update expected value of make_interval

277aac4

alamb commented Jan 10, 2026

View reviewed changes

Update expected output

bb29b0c

alamb commented Jan 10, 2026

View reviewed changes

alamb mentioned this pull request Jan 10, 2026

feat: change default behavior for Parquet PageEncodingStats to bitmask apache/arrow-rs#9051

Merged

Update to latest arrow

35b97fa

alamb mentioned this pull request Jan 10, 2026

fix: liberal parsing of zero scale decimals apache/arrow-rs#8700

Merged

Update again

c1d27d3

Update rev

1b979c6

Merge branch 'main' into alamb/update_arrow_58

c3df7be

WIP: Upgrade DataFusion to arrow-rs/parquet 58.0.0 #19728

Are you sure you want to change the base?

WIP: Upgrade DataFusion to arrow-rs/parquet 58.0.0 #19728

Conversation

alamb commented Jan 10, 2026

Which issue does this PR close?

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Uh oh!

alamb Jan 10, 2026

Choose a reason for hiding this comment

Uh oh!

davidlghellin Jan 10, 2026

Choose a reason for hiding this comment

Uh oh!

Jefffrey Jan 10, 2026

Choose a reason for hiding this comment

Uh oh!

alamb Jan 10, 2026

Choose a reason for hiding this comment

Uh oh!

Dandandan commented Jan 10, 2026

Uh oh!

alamb-ghbot commented Jan 10, 2026

Uh oh!

alamb-ghbot commented Jan 10, 2026

Uh oh!

Dandandan commented Jan 10, 2026

Uh oh!

Dandandan commented Jan 10, 2026

Uh oh!

alamb-ghbot commented Jan 10, 2026

Uh oh!

alamb-ghbot commented Jan 10, 2026

Uh oh!

Dandandan commented Jan 22, 2026

Uh oh!

alamb-ghbot commented Jan 22, 2026

Uh oh!

alamb-ghbot commented Jan 22, 2026

Uh oh!

Dandandan commented Jan 22, 2026

Uh oh!

alamb-ghbot commented Jan 22, 2026

Uh oh!

Dandandan commented Jan 22, 2026

Uh oh!

alamb-ghbot commented Jan 22, 2026

Uh oh!

alamb-ghbot commented Jan 22, 2026

Uh oh!

alamb-ghbot commented Jan 22, 2026

Uh oh!

alamb-ghbot commented Jan 22, 2026

Uh oh!

alamb-ghbot commented Jan 22, 2026

Uh oh!

alamb-ghbot commented Jan 22, 2026

Uh oh!

Dandandan commented Jan 23, 2026

Uh oh!

alamb-ghbot commented Jan 23, 2026

Uh oh!

alamb-ghbot commented Jan 23, 2026

Uh oh!

alamb-ghbot commented Jan 23, 2026

Uh oh!

Dandandan commented Jan 23, 2026

Uh oh!

alamb-ghbot commented Jan 23, 2026

Uh oh!

alamb-ghbot commented Jan 23, 2026

Uh oh!

alamb-ghbot commented Jan 23, 2026

Uh oh!

alamb-ghbot commented Jan 23, 2026

Uh oh!

alamb-ghbot commented Jan 23, 2026